Estimation of Continuous-Discrete Valued Markov Processes
نویسندگان
چکیده
منابع مشابه
Discrete-valued ARMA processes
This paper presents a unified framework of stationary ARMA processes for discrete-valued time series based on Pegram’s [Pegram, G.G.S., 1980. An autoregressive model for multilag markov chains. J. Appl. Probab. 17, 350–362] mixing operator. Such a stochastic operator appears to be more flexible than the currently popular thinning operator to construct Box and Jenkins’ type stationary ARMAproces...
متن کاملDiscrete Time Markov Processes
What follows is a quick survey of the main ingredients in the theory of discrete-time Markov processes. It is a birds' view, rather than the deenitive \state of the art." To maximize accessibility, the nomenclature of mathematical probability is avoided, although rigor is not sacriiced. To compensate, examples (and counterexamples) abound and the bibliography is annotated. Relevance to control ...
متن کاملMarkov Reward Models and Markov Decision Processes in Discrete and Continuous Time: Performance Evaluation and Optimization
State-based systems with discrete or continuous time are often modelled with the help of Markov chains. In order to specify performance measures for such systems, one can define a reward structure over the Markov chain, leading to the Markov Reward Model (MRM) formalism. Typical examples of performance measures that can be defined in this way are time-based measures (e.g. mean time to failure),...
متن کاملContinuous time Markov decision processes
In this paper, we consider denumerable state continuous time Markov decision processes with (possibly unbounded) transition and cost rates under average criterion. We present a set of conditions and prove the existence of both average cost optimal stationary policies and a solution of the average optimality equation under the conditions. The results in this paper are applied to an admission con...
متن کاملKernel Estimation for Real-valued Markov Chains
Let {Xn : n = 0, 1, 2, ...} be a real-valued Markov chain. The purpose of this paper is to study properties of kernel type estimators of the stationary density and of the transition density of such a chain. These estimators were considered first by Roussas (1969) and by Rosenblatt (1970). Both authors extended to the Markov chain case some results for kernel estimators of the density based on a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Transactions of the Society of Instrument and Control Engineers
سال: 1978
ISSN: 0453-4654
DOI: 10.9746/sicetr1965.14.538